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(54) Title: METHOD AND APPARATUS FOR ACOUSTIC HOLOGRAPHIC IMAGING IN MARINE AND OTHER 
ACOUSTIC REMOTE SENSING EQUIPMENT 



(57) Abstract 

The invention relates to acoustic imaging methods and appara- 
tus intended to improve the performance and reduce the cost and 
complexity of such methods and apparatus. Accordingly, the method 
comprises the steps of : (a) between periodic acoustic pulses sampling 
output signals from a plurality of transducer at a predetermined rate; 
(b) digitising and storing the samples; (c) for each pixel of an image 
(i) selecting a corresponding set of samples from each transducer; (ii) 
correcting each selected sample set by interpolation so that it is pre- 
cisely aligned with the required time of flight from pixel point to 
transducer; (iii) deriving a composite signal representing the strength 
of the reflected pulse from the point; and (iv) deriving the intensity of 
the pixel from the composite signal. The apparatus comprises a sonar 
head (10), consisting of the transducers and a pulse transmitter, data 
acquisition and storage means (12), and data processing and image 
generation means (14). 
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Method and Apparatus for Acoustic Holographic Imaging In 
Marine and other Acoustic Remote Sensing Equipment 

Introduction 

The present invention relates to acoustic imaging 
methods and apparatus. The methods and apparatus disclosed 
are primarily intended for marine -sonar survey applications, 
but are also applicable to other applications of acoustic 
imaging. 

1 . Background of the Invention 

1.1 State of the Art 

Much of current research into signal processing of 
array/ antenna sensor data is concerned with the theory of 
manipulating digitised baseband "in-phase" and "quadrature" 
components. Here mathematical tools taken from modern 
spectral analysis methods are applied to the array concept 
of "spatial frequency". Work on "super-resolution" and 
adaptive processing has become both very fruitful, and 
extremely popular in academic and industrial circles, no 
doubt because of well-funded military applications . 

One of the best-known super-resolution algorithms is 
MUSIC (Multiple Signal Classification) , based on 
eigenvalve / eigenvector analysis of signal statistics. MUSIC 
and other related algorithms aims at resolving far-field 
directional sources beyond the Rayleigh limit. The 
methodology is closely related to that of adaptive pattern 
nulling, where the characteristic feature of an adaptive 
array is the automatic rejection of directional 
interference. 
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If these algorithms are applied to the near-field 
situation , null-filling and directional mismatch are 
observed. For example adaptive nulling results in much 
shallower nulls, which appear in the wrong positions. It was 
the realization that the planar wavefront approximation is 
frequently inadequate that spurred research into imaging 
near-field objects , initially for medical imaging and non- 
destructive testing of materials. One existing approach, 
which derived from early research, is called the "Synthetic 
Aperture Focussing Technique" (SAFT) [1]. This employs a { 
single transducer which moves linearly along an object 
surface, while transmitting a spatially wide beam into the 
object, and receiving return echoes at a constant spatial 
interval. The received signal is digitised immediately and 
stored in 2D memory. A "focus table" for each pixel in the 
image is accessed during image reconstruction. Only one 
real-time SAFT imaging system has been reported [2] which 
operated at 2.7 - 4.3 MHZ, using a very short 2.5 cycle 
source signature. 

Another real-time focussing imaging system developed by 
J. F. McDonald et al. [3] acquires data at 10 Hz on all 256 
elements after a single 5 MHZ ping and constructs a 2D ( 
hologram of the ultrasonic image using the "backward-wave 
propagation" technique [4,1] with fast digital hardware. 

Another such "within pulse" technique using unmodulated 
data exists [5], however this is a theoretical approach to 
vector scanning sonar using the "spacial frequency" concept 
assuming a far field source. 

In conclusion the focusing systems find applications in 
the small-scale very-high frequency non-destructive testing 
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and medical imaging fields mentioned earlier [4,7] while the 
MUSIC /adaptive systems have been developed to acquire highly 
directional information about a few; usually military 
targets . 

Therefore, although there is a considerable amount of 
sophisticated signal and array processing research, little 
of it appears directly relevant to the sonar survey problem, 
characterized by kHz frequencies and long pulse lengths, and 
where there are immediate advantages in being able to 
reconstruct an image of the complete area insonified by each 
ping, with the area containing as many potential 
near/medium-f ield "targets" of interest as there are pixels 
in the image. 

2. Objects of the Invention 

2 . 1 General 

2.1.1 Improvements to Sonar Imaging Equipment 

The main object of the invention is to improve the 
performance, and eventually to reduce the complexity and 
cost> of a wide range of acoustic remote sensing equipment, 
used to survey water volumes (Eg. fish shoal detention) , the 
sea-floor, and the sub-bottom region below the sea-floor. 
The invention is applicable to standard acoustic sensing 
modes such as sector-scan sonar, side-scan sonar, and sub- 
bottom profiling. 

2.1.2 Whole Scene Reconstruction 

Using existing sonar equipment, it is only possible to 
image the insonified field of view in one particular 
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direction, unless some form of mechanical or electronic 
scanning is employed • The invention allows a whole 
insonif ied scene to be reconstructed from a set of digitised 
samples without the need for any form of special scanning 
equipment . 

2,1.3 Swath Bathymetry 

Swath bathymetry is an acoustic survey mode which 
allows the precise depth of the sea-floor or other water 
bottom to be measured in a strip on either side of the ^ 
survey vessels track- Such survey is normally carried out 
with special forms of "multi-beam" sonar, which require 
complex electronics to produce. The invention allows swath- 
bathymetry to be carried out using either a towed sonar 
array, or an array mounted on the hull of the survey vessel 
without the need for special electronics. 

2.1.4 Simplicity and Cost 

The Invention replaces conventional "front-end" 
electronics with a single Digital Sampling Unit* Subsequent 
processing is carried out digitally. This form of equipment 
can take advantage of the reducing cost and increasing ^ 
performance of digital processing elements as technology 
develops . 

2.1.5 Commonality and Flexibility 

Using the Invention , almost identical processing 
modules can be used in the different acoustic sensing modes, 
such as sector-scan and side-scan. This brings considerable 
advantages to any manufacturer for product rationalization. 
In addition it allows processing modules to be shared 
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between different acoustic sensors in ROV (remotely operated 
vehicle) applications, and other situations where space and 
electrical power are limited - 

2.1.6 Performance Advantages 

Equipment embodying the Invention can offer superior 
performance to existing equipment > both in terms of image 
quality, and in the ability to select chosen regions of the 
whole image for larger-scale display and subsequent computer 
image-analysis. 

2.1.7 Other Application Areas 

The principles embodied in the Invention can also be 
applied to other acoustic imaging equipment, for example to 
medical ultrasonic scanners. 

2.2 Advantages due to Table-driven Processing 

2.2.1 General 

Selection and accurate reconstruction of the acoustic 
image is carried out in the invention using one or more 
Time-Delay Look-Up Tables, stored in digital form. The 
ability to compute these Tables to embody geometric 
corrections/ and to change or update the Tables for specific 
purposes, brings a wide range of performance advantages 
illustrated below., 

2.2.2 Imaging in Reguired Coordinate System 

A typical problem with existing sonar equipment is to 
convert the image from polar to cartesian coordinates for 
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operator interpretation, or subsequent computer processing. 
This conversion may require additional electronics, but in 
any case the image information is degraded as a result of 
the resampling implicit in the scan conversion procedure. 
Using the Invention, the coordinate system required for the 
image is allowed for in the Look-up Table values, and no 
conversion is necessary. 

2.2.3 Dynamic Focus 

Using existing sonar equipment, additional electronics 
are required to focus objects in the near field of the array 
where curvature of the echo wavefront is significant. Using 
the Invention, Dynamic Focus is achieved by correct 
computation of the Look-Up Tables. 

2.2.4 Non-Linear Array Geometry 

It is sometimes desirable to use sonar arrays which are 
non-linear in a geometric sense, for example to bend around 
the hull of a vessel. Using the Invention, the changes 
required to the imaging procedure can be allowed for in the 
Look-Up Table values. 

( 

2.2.5 Zoom Display 

It is a common operational requirement to be able to 
survey the whole insonified scene out to maximum range, and 
then to be able to image a selected area of interest for 
display at larger scale. This facility can be provided by 
substituting new Look-Up Tables. The Invention includes a 
special form of Look-Up Table which reduces the digital 
processing required to achieve this. 
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2.2.6 Stabilized Display 

By updating the Look-Up Tables as the sonar platform 
moves through the water medium, it is possible to stabilize 
the resultant acoustic image against either translation of 
the sonar platform, or change in attitude (Roll, Pitch, Yaw) 
or both. This possibility offers several distinct 
performance advantages, for example; 

(a) detection of targets which are moving in the ground 
f rame-of-ref erence by subtraction of successive 
stabilized images. 

(b) improvement in the signal/noise ratio for stationary 
objects by integration (time-averaging) of successive 
images. 

(c) simplification of the human interpreter's task, for 
example comparison of the image with some form of chart 
or map. 

2 • 3 . Improv ements Related to Whole-Scene Imaging 

The ability to image a whole area or sector of the 
insonified scene carries important advantages even in 
situations such as side-scan survey where full coverage can 
be obtained by movement of the sonar platform. In particular 
a particular object or area of interest will be "viewed" 
from different angles as the platform moves, which permits 
either the view with the greatest contrast to be selected, 
or the f lunctuations in echo strength to be used to assist 
in object classification. It is well known that echoes from 
man-made objects normally f lunctuate with direction in a 
different manner than echoes from natural objects. 
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3 - Summary of the Invention 

In accordance with a first aspect of the invention 
there is provided an acoustic imaging method for 
marine survey and other purposes wherein a target 
area is insonified by periodic acoustic pulses, 
reflections of said pulses are detected by an array of at 
least two transducers which generate output signals in 
response thereto , and said output signals are processed so 
as to produce an image of all or part of the insonified 
target area, said image comprising an array of pixels each 
corresponding to a point in the insonified area and the 
intensity of each pixel representing the strength of the 
pulse reflected from said corresponding point , comprising 
the steps of 

sampling the output signals from each of said 
transducers at a predetermined rate during the period 
between said transmitted pulses; 

digitizing and storing said samples; 

for each pixel of the image, 

(i) selecting a corresponding set of digitized samples 
from each transducer, the selection of the sample 
set being determined by the time of flight of a 
transmitted pulse to the point in the insonified 
area corresponding to the pixel and back to the 
particular transducer in the array; 



(a) 



(b) 
(c) 
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(ii) correcting each selected sample set by some form 
of interpolation so that it is precisely aligned 
with the required time of flight; 

(iii) deriving a composite signal representing the 
strength of the reflected pulse from said 
corresponding point; and 

(iv) deriving the intensity of the pixel from said 
composite signal. 

Preferably, steps (c) (ii) and (iii) above are executed 

(i) estimating the in-phase and quadrature 
coefficients for one or more frequency components 
present in each sample set using quadrature 
matched filtering , Discrete Fourier Transform 
computation, or other technique which involves the 
convolution of the sample set with one or more 
pairs 6f sets of predetermined coefficients; 

(ii) computing the frequency coefficients for the 
required time-shifted sample set by phase-shif ting 
the pairs of coefficients for each frequency 
component estimated in (i) above; 

(iii) combining the phase-shifted coefficients for each 
frequency component from all transducers to 
generate the corresponding coefficients for the 
composite signal; 
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(iv) deriving the strength of the reflected pulse from 
the frequency coefficients of the composite 
signal. 

A preferred form of step (iv) above to achieve pulse 
compression of frequency-modulated (chirp) pulses comprises 
adding the cross-products of the in-phase and quadrature 
frequency components of the composite signal with the 
corresponding predetermined frequency component of the 
transmitted pulse. 

An adaptation of the basic method for swath bathmetry 
comprises the steps of: 

(a) orienting an acoustic transmitter array in such a manner 

that a narrow strip of the sea-floor is insonified at 
right angles to the direction of motion of the vessel 
of other vehicle used for survey; 

(b) orienting an acoustic receiver array in such a manner as 

to image the sector below the array including the 
insonified sea-floor intercept; 

(c) after each pulse transmission, imaging a selected area 

of the scene which includes the sea-floor intercept 
using the basic method defined above; 

(d) locating the pixels in the image corresponding to the 

sea-floor intercept by means of standard signal or 
image processing techniques; 

(e) using horizon intercept determined from one or more 

previous insonif ications to select the area for which 
the image needs to be computed after the next 
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insonif ication. 
A preferred method of determining the times of flight 
specified in step (c) (i) of the basic method uses 
digital Time-Delay Look-Up Tables which may be wholly 
or partly predetermined, such Look-Up Tables being 
adapted to offer specific imaging facilities including: 

(a) geometric correction for near-field focus 

(b) geometric slant-range to true-range correction for 
side-scan sonar 

(c) geometric correction for non-linear array shapes 

(d) imaging in the required f rame-of-ref erence 

(e) displaying stabilization against translation or change 
of attitude of the sonar array 

(f) enlarge ("zoom") display of a part of a previous scene 

selected by the human operator or by automatic computer 
processing, such enlarged image to be at the higher 
acoustic resolution available at the new scale. 

A preferred method of generating the Time Delay Look-Up 
Tables is based on the time delay from a given pixel point 
to a selected reference element on the array plus the 
differential delays to other transducers of the array. 

A further preferred method of generating and updating 
the such Tables uses finite difference equations which allow 
for the appropriate angular relationships in the scene to be 
imaged . 
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In accordance with a second aspect of the invention, 
there is provided an acoustic imaging apparatus for marine 
survey and other purposes comprising transmitter means for 
transmitting periodic acoustic pulses, an array of at least 
two transducers for detecting reflections of said pulses 
from a target area and for generating output signals in 
response thereto, and means for processing said output 
signals so as to produce an image - of at least a part of said 
target area, said image comprising an array of pixels each 
corresponding to a point in said target area and the 
intensity of each pixel representing the strength of the { 
reflected pulse from said corresponding points; and further 
comprising: 

data acquisition and storage means for sampling the 
output signals from each of said transducers at a 
predetermined rate during the period between successive 
transmitted pulses and for digitising and storing said 
samples; and wherein 

said data processing and image generation means is 
adapted to select a set of digitised samples from each 
transducer for each pixel of the image, said selection being 
determined by the time of flight a pulse from the { 
transmitter means to the corresponding point in the target 
area and back to the array, to correct each selected sample 
set by some form of interpolation so that it is precisely 
aligned with the required time of flight, to derive a 
composite signal from the time-shifted sample sets for each 
pixel, representative of the strength of the reflected pulse 
from the corresponding point, and to derive an intensity 
value for each pixel from its corresponding composite 
signal. 
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The data processing and image generation means may be 
adapted to perform any of the particular optional method 
steps defined above. 

The data acquisition and storage means preferably 
includes means for amplifying the analogue signals received 
from the transducers fo the array, analogue to digital 
conversion means for sampling the. analogue signals, and 
means for multiplexing the signals from each transducer 
channel* 

In a parallel implementation , the analogue output 
signals from each transducer channel are amplified and 
digitised separately, and the parallel , digital signals are 
digitally multiplexed prior to storage.' 

In a serial implementation, the analogue output signals 
from the transducers are amplified separately in a first 
amplification stage, the parallel , amplified analogue 
signals are analogue multiplexed, and the multiplexed, 
analogue signal is further amplified prior to digitisation 
and storage. The further amplification stage is a digital 
switched gain stage wherein the gain is adjusted to 
compensate for attenuation of the reflected signals. The. 
serial implementation preferably also includes similar pre- 
amplif ication and digital switched gain stages for each 
transducer channel prior to digitisation. 

The date acquisition and storage means preferably 
further includes timing and control means to control the 
multiplexing means, digitally switched gain and 
digitisation. 
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These and further aspects and features of the invention 
will be apparent from the following description of 
embodiments of the invention , given by way of example only, 
with reference to the accompanying drawings, 

4 . Description of Drawings 

Fig. l is a block diagram of an acoustic imaging system 
embodying the invention; 

Figs. 2(a) and 2(b) are, respectively, schematic 
illustrations of alternative parallel and serial 
implementations of the data acquisition means of the system 
of Fig. 1; 

Fig. 3 is a more detailed block diagram of a serial 
implementation of the serial data acquisition means fo Fig. 
2 (b) ; 

Fig. 4 is a further schematic illustration of a serial 
data acquisition arrangement similar to that of Fig. 3; 

Fig. 5 is a flow chart illustrating the steps of a data 
processing and image generation method in accordance with 
the invention; 

Fig. 6 is a schematic illustration of two prior art 
approaches to beamforming in sonar systems; 

Fig. 7 is an illustration of a typical source signal as 
used in the described embodiments of the invention; 

Fig. 8 is a simplified illustration of an insonified 
scene with a superimposed grid; 
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Fig. 9 is similar to Fig. 8, and illustrates 
stabilisation against movement of the transducer array; and 

Fig. 10 is similar to Figs. 8 and 9, and illustrates 
differential delays to different transducers of the array 
with the array yawed through an angle a. 

5. Detailed Description of Preferred Embodiments 

5 . 5 System Overview 

The overall system consists of two main modules: 

(a) Data Acquisition and Storage 

■(b)- Data Processing and Image Generation 

Fig. l is a block diagram illustrating the system, 
comprising a sonar head 10 consisting of an array of 
ultrasonic transducers and a pulse transmitter or 
projection, Data Acquisition and Storage means 12 , " and Data 
Processing and Image Generation means 14. The sonar head 10 
itself is of conventional type and will not be described in 
further detail herein. The number of transducers in the 
array can vary, and useful basic imaging can be accomplished 
with relatively few transducers down to a minimum of two. 
The Data Acquisition and Storage means 12 is adapted to 
amplify, digitize, sample and store the signals received 
from the sonar head 10, and the Data Processing and Image 
Generation means 14 processes the stored samples to generate 
the required images. These are described in greater detail 
below. 
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5.2 Data Acquisition and Storage 

The Data Acquisition and Storage means 12 comprises: 

(a) Front-end amplifier and digitisation unit; 

(b) Digital interface to the software processor to perform a 
direct memory access (DMA) operation. 

As the holographic sonar concept requires both amplitude 
and phase information it is essential that in the sonar ^ 
front-end all channels have identical transmission 
characteristics. Two configurations for the data acquisition 
means can be implemented, as shown in Figs. 2(a) and 2(b). 

Fig- 2(a) shows a parallel implementation wherein each 
transducer of the sonar head 10 is connected to a digital 
multiplexer 16 via separate pre-araplif ication stages 18, 
digitally-switched-gain amplification stages 2 0 and 
analogue-to-digital conversion means (A/D) 22. The output 
from the multiplexer 16 is transmitted to digital memory for 
subsequent data processing. 

Fig. 2(b) shows a serial implementation wherein each ^ 
transducer of the sonar head 10 is connected to an analogue 
multiplexer 24 via separate pre-amplif ication stages 26. 
The output from the multiplexer 24 is then transmitted via a 
single digitally-switched-gain amplification stage 28 to A/D 
30, and thence to digital memory 32 for subsequent 
processing in the data processing and image generation means 
14. 

The parallel implementation represents the best option 
in terms of A/D performance as the conversion speed need 
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only be above the single channel Nyquist rate. The ability 
to match amplitude and phase characteristics in the 
amplifiers was at first thought to be a problem and for this 
reason the serial implementation was chosen instead. 
Additional tests on a prototype digital switched gain board 
however confirms that the problem of matching channels may 
not be as difficult as expected. 

When opting for a serial implementation only initial 
amplification 26 is in parallel, the signal then being 
analogue multiplexed into a single channel. The single 
channel is then amplified in a common time switched gain 
module 28 and A/D/30. The A/D/30 must however handle the 
time division multiplexed signal and has thus a times n 
(channels) increase in convertions rate*. 

The DMA operation is currently performed at a rate of 
lOMbytes/s into a modified graphics processor board, 
Scanbeam. It is technically possible to increase this rate 
to well over 20Mbytes/s using off the shelf technology. 

The 10 MHz DMA restriction has fundamental 
implications on the overall system design. In the present 
example a 360kHz sonar array is used. In order to capture 
the raw sonar data a digitisation rate for each channel must 
agree with the Nyquist sampling theorem. The Nyquist Low- 
pass theorem dictates a rate of over twice 3 60kHz. This 
limits the number of channels to the order of 12 . The number 
of channels in turn sets the aperture size and hence the 
angular resolution. If the size of the DMA RAM storage is 
1Mbyte, then in combination with the digitisation rate this 
sets the total range to the order of 20 metres. 
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The sonar transmitter can however be thought of as a 
narrow-band source so the sampling rate can be equated to 
the Nyqulist Band-pass theorem. Given a bandwidth of 
typically 5% of the carrier we can see that a twenty fold 
increase in the aperture size is quite feasible. For the 
purposes of the present example this was not implemented as 
it was adequate for experimentation to restrict the number 
of channels to the order of nine . . 

The total sonar is split into 3 parts, the array 
itself, the amplifiers and digitisation module, and the i 
digital storage and processing engine. Physically these 
three outlets are interconnected by cables. The output from 
each element of the array feeds up individual 60 ohm twisted 
pairs using a differential cable driver- and into the input 
connecter of the amplifier and digitisation module. The 
output of the A/D converter on the digitization unit is 8- 
bit ECL parallel data and is cabled into the input connector 
of the VME host processor. 

Fig. 3 illustrates the architecture of a serial 
system embodying the invention, in this case having an array 
of fifteen transducer elements, comprising a sonar head 40, 
data acquisition means 42 and data storage/processing means ( 
44. 

The head 40 comprises an array of transducers and 
pre-amps 46, each connected to a separate output channel, 
and projectors and power-amps 48. The data acquisition 
means 42, which also controls the projectors 48, comprises 
separate input amplifiers connected to each transducer 
channel and disposed on three identical cards 50, 52 and 54. 
The outputs from the input amplifiers are connected to the 
inputs of analogue multiplexer 56, and the output from the 
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multiplexer 56 to an analogue to digital converter 58 via 
digital switched gain card 60 • The output from A/D 58 is 
connected to the memory of the data storage/processing means 
44. The data acquisition means 42 further includes a power 
supply card 62, which provides power supplied for the 
analogue and digital data acquisition circuitry, a low pass 
filter and line driver card 64 connected to the projectors 
48 of the head 40, and a main control board 66 which 
controls the timing of the various system components and 
generates pulses for driving the projectors 48 via the 
filter card 64, 

Fig. 4 is a schematic block diagram of a similar, n- 
channel serial system wherein the outputs from the 
transducers 70 are fed to an analogue multiplexer 72 via 
input amplification stages 74(a), 74(b) and 74(c). 

The twisted pair cables from the array are connected 
to input amplifiers. The input amplifiers have a total of 
56 dB of matched gain for each channel prior to multiplexer- 
input. This gain is split into three blocks; a first stage 
74(a) of fixed 20 dB f a second stage of gain 74(b) 
selectable as either plus or minus 18 dB, and finally a 
buffer gain 74(c) of 18 dB driving 50 ohms. The selectable 
plus and minus 18 dB of gain is used to ensure that the 
power levels into the multiplexer 72 remains high for the 
full echo return time. This high level signal ensures 
optimum performance from the analogue switches in the 
multiplexer. For target returns close to the array the 
acoustic echo returns are such that minus 18 dB of gain 
maintains a high input level into the multiplexer. As echo 
returns are received from more distant targets the incoming 
power level falls off and to keep the signal levels high the 
plus 18 dB gain is then selected. These input gains may 
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require a degree of adjustment in practice. The range at 
which the gain change occurs is set by a timing and control 
card 76. 

In the present system the analogue multiplexer 72 
consists of a nine-to-one channel multiplexer ( mux) . 
Multiplexing is achieved using Siliconix quad analogue 
switches (SD5002) . The 5D5002 is a, DMOS FET switch with 
switching times of ns. The specification for the mux. is 
that it must switch the nine channels with a lOMhz clock 
rate. The mux. was designed to have a 12ns switching time g 
and the timing of the A/D 78 set to correspond to the middle 
of the switching period. To achieve the DMOS FET switching 
rate the gate drive must shift from plus 15 volts to minus 
15 volts in less than lOns, which is achieved by means of a 
discrete transistor circuit. The gate control signals are 
ECL timing signals from the timing and control card 76. 
After multiplexing the single channel is passed through a 20 
dB attenuator 80 before entering the Digital Switched Gain 
card(DSG) 82. This card is designed to compensate for the 
normal attenuation characteristics of acoustic waves in 
water. An analogue switched gain circuit based on log 
amplifier technology would have a dubious phase 
characteristic over the full swept gain range, so a | 
digitally switched gain board is preferred. 

This board uses a number of high performance 
operational amplifiers (OPA6 75 swop amps) and analogue 
switches in different gain stages at the appropriate time in 
the attenuation curve. This board keeps the actual gain 
within 6dB of the theoretical gain required. As the output 
of this card feeds the A/D 78 converter the DSG circuit 
ensures that the A/D maintains an acceptable dynamic range 
for the full target range. The timing for this card is 



WO 92/00584 



PCT/GB91/01058 



21 



derived from the control card 76. The gain selection times 
are pre-programmed in a ROM. 

The Analogue to Digital converter 78 is an 8-bit Date! 
8303E, a development card. This card h<as an input analogue 
bandwidth of 40 MHz, a system requirement due to the slew 
rate specification at the output of the multiplexer. The 
output data is converted into ECL signals for output on the 
cable connecting the software processor. 

The control and timing card 76 performs much of the 
system clocks and time references. This card also includes 
the transmitter EPROM which is pre-programmed with the 
windowed sine wave transmitter shape values. An 8 -bit D/A 
circuit reads the output from the EPROM and this signal is 
sent to the projector power amplifier 80. 

The digital storage is performed using a Scaribeam 
graphics processor board modified by a separate main 
controller board to act as a 10 MHz DMA. 

5.3 Data Processing and Image Generation 

5.3.1 Overview 

5.3,1.1 Introduction . 

Fig 5 gives a general block diagram for the image 
generation computation. The processing in the individual 
blocks varies in detail depending on the specific 
application - sidescan, sector-scan, seismic processing, 
chirp source etc. but the framework remains the same. This 
schematic diagram does not exclude other possible processing 
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steps which may assist in specific instances, for example 
swath bathymetry. 

It will be easiest to understand the block diagram if 
the conceptual steps are described from a conventional 
phased-array sonar Receiver (Fig 6) to the digital 
holographic scheme of the present invention. 

5.3.1.2 Phased-Arrav Sonar 

This system consists of a linear array containing K+l * 
transducer elements, {T k } k=O...K, spaced at equal intervals 
of d along the array. 

The array is steered to an angle, a., with respect to 
the array normal in order to point at the reflector, P, in 
the far-field. This point is sufficiently distant from the 
array for the curvature of the echo wave-front to be 
negligible across the array, so that the wave-front can be 
assumed to be plane. 

Let U be the speed of sound in the medium (assumed 
constant) . Then the echo from P reaches each transducer in 
turn, beginning with T Q/ with a time delay of t = d*sin(a)/li 
between adjacent transducers. 

In order to image the point P, the signal received from 
the transducer, T k is delayed by a time (K-k)*t before 
adding the sum amplifier. This specific set of time delays 
aligns the signals received from. P, so that they 
constructively add together. The same is true for any far- 
field point subtending the same angle, a, with the array 
normal. However signals received from a point subtending a 
different angle destructively interfere with each other. 
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This form of processing creates a sonar receiver beam 
pointing in the direction, a. The width of the beam depends 
on the carrier frequency of the sonar signal which is echoed 
from P. The nominal value is usually given as 1/L radians , 
where 1 is the wavelength of sound in the medium, and L is 
the length of the array. 

The standard engineering for the phased-array sonar is 
to implement the delay-sum architecture using tapped delay 
lines or other analog, or hybrid digital/analog, circuitry. 
Processing is carried out in real-time as the echo is 
received, and is only carried out for one specific beam 
angle at any time. The sum amplifier is followed by some 
f orm of detector which is used to estimate the power in the 
echo, averaged over a time-interval. In an analog sonar, the 
averaging time is roughly equal to the length of the 
transmitted pulse-packet, although the signal may later be 
smoothed over an interval equivalent to the resolution of 
the chart recorder. A variety of detection techniques are 
employed, ranging from simple half -wave rectifiers to 
correlation detectors. 

In order to image a point in the near-field correctly, 
account must be taken of the curvature of the wavefront. The 
time-delays between adjacent transducers are no longer 
constant. Additional circuitry in the delay-sum architecture 
can be provided to modify the set of time delays to achieve 
such "dynamic focus", but the complication is significant. 

5.3.1.3 Digitised Sampled Data 

Conceptually the same processing scheme can be employed 
with signals which are quantised both in magnitude and in 
time. The sampled signal from the transducer Tl must now be 
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delayed by the number of samples which approximates in time 
to (K-k)*t as in the analog scheme. The time averaging of 
the composite signal is achieved by forming the sum of 
squares : 

w=2 (S 2 ) , 



where the summation is taken over the number of samples in 
the required time-window, and Sj denotes the j'th composite 
sample formed by summing the delayed transducer samples. Thtgk 
rms power can be obtained directly from W if required. 

For this simple scheme to work, very high sampling 
rates are required, as the following example demonstrates. 
Consider a sonar receiver consisting of 33 transducer 
elements, and designed to operate with a carrier frequency 
of 100 kHz. For effective imaging, the error in the time- 
delay applied to each transducer signal, must not exceed a 
small fraction, say 1%, of the carrier period, which is here 
10 microseconds. Since the possible time delay error with 
the simple scheme is 1/2 the sampling period, the sampling 
period itself should not exceed 200 ns, which implies a 
sampling rate of 5 MHz. This is in itself rather high, but £ 
the total sampling rate from the whole set of transducers 
amounts to 165 MHz. 

The simple system has the disadvantages that the 
digitisation rate is so high that the required sampling 
circuitry is very expensive, and that a large number of 
sample values must be stored to enable the computation to be 
carried out. 



5.3.1.4 Interpolation in the Time-Domain 



WO 92/00584 



PCT/GB91/01058 



25 



In order to reduce the sampling rate, some method is 
required to interpolate between sample points in order to 
estimate the signal for any time delay which is not 
coincident with a sampling instant. The most obvious way to 
do this is by interpolation in the time-domain, for example 
by linear or polynomial interpolation between sample points. 
Such techniques can reduce the sampling rate by an order of 
magnitude , but the engineering still remains expensive 
unless the carrier frequency is low. 

As discussed in 5.3*1.3 above, estimation of the rms 
power in a given pixel is obtained by forming a sum of 
squares of the composite samples within the time window. 
Time-domain interpolation is only accurate when the sampling 
rate is high in comparison with the carrier frequency, so 
that the number of samples within a typical pulse envelope 
is also large. Hence the computation required to sum the 
squares of such samples is also expensive. 

5.3.1.5 Interpolation in the Frequency-Domain 

This technique is the preferred method used in the 
present invention. To understand the principle, first 
consider an analog signal S(t) consisting of a single 
frequency, f: 

S(t) = a sin(27rft) + b cos(27rft). 

The signal, S f (t), is a copy of S(t) delayed by a time, h. 
Then: 

S«(t) = a cos [27rf(t+h)] + b sin[27rf (t+h) ] 
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= a cos [27rft+u] + b sin[27rft+u] 
where the phase-shift, u = 27rfh. 
Further : 

S»(t) = a' cos(27rft) + b' sin(27rft), 

where a 1 = a cos(u) + b sin(u) . . 

b 1 = a sin(u) + b cos(u), ^ 

The above simple mathematics shows that the in-phase 
and quadrature components, a and b, of a sinusoidal signal 
delayed by a time t can be computed directly from the 
Fourier components of the original signal using the phase- 
shift 277-ft, where f is the signal frequency. Now consider a 
more general signal which can be represented by the spectral 
decomposition: 

S(t) = E[a n cos(27rf n t) + b n sin(27rf n t) ] 
n 

Then the delayed signal, S 1 (t) is given by 

S'(t) = 2[a'cos(27rf n t) + b' sin(27rf n t) 
n n 

where 

a 1 = a n cos(u n ) + b n sin(u n ) 
n 



b'=-a n sin(u n )+b n cos(u n ) 
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n 

and u n = 27Tf n t. (5.1) 

The above analysis leads directly to the proposed method 
of delaying sampled data sets by first estimating the 
spectral content. Since there are a variety of methods for 
estimating the spectral content of sampled data, there is 
now no particular problem of achieving any specific small 
delay required. Moreover if the bandwidth of the signal is 
known to be small, the required spectral estimation can be 
carried out using both a small number of frequency 
components, and a small sampling frequency given by the 
Nyqulist Theorem as twice the bandwidth. 

5.3.1.6 Local Spectral Estimation 

In the block diagram, Fig 5, the signals received from the 
entire set of transducers have been multiplexed, sampled, 
and stored. There is some time offset between the sample 
sets from the different transducers, but this can be ignored 
for the purpose of the description. It is also possible that 
some processing can be carried out "on-the-f ly M before 
storage, but this again does not change the concept. 

The first stage of processing is to carry out a local 
spectral estimate for each transducer signal for each sample 
point in turn. This could be a full local Discrete Fourier 
Transform (DFT) , but it will be shown below that simpler 
processing is sufficient. In any case the processing 
consists of estimating the in-phase and quadrature frequency 
components of different subsets of the stored transducer 
samples for a discrete set of frequency values. These 
components are calculated by convolving the sample sequence 
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for each transducer with a set of FIR filters, one pair for 
each frequency required. One convolution kernel in each pair 
gives the in-phase component a n for that frequency, f n " and 
the other kernel gives the quadrature component, b n . The 
results of this set of convolutions are held in the 
Frequency Component Store. Each pair of values in this store 
gives the in-phase and quadrature coefficients for a certain 
transducer for the set of samples- contained in a time window 
centred on the corresponding sample in the Sample Store. 

If M component frequencies are used in the spectral { 
estimate, and N sample values are held in the Sample Store, 
then there are 2MN Frequency Components to be computed and 
stored, though not necessarily simultaneously - 

5.3.1.7 Time-Delav Look-Up Tables 

Suppose we wish to generate an image consisting of a 
set of pixel points, where each pixel in the image 
corresponds to a point (X,Y) in the insonified field. We 
call such corresponding points "pixel points". For a given 
image size with a given pixel point spacing, it is possible 
to precompute the time delay from transmission of the 
outgoing pulse for its echo to reach each transducer from 
each pixel point. For example, if there are 33 transducers, 
and 512 x 512 pixels in the image, then there are 
approximately 8 x 10 6 delay values to be computed. These 
precomputed delay values can be stored in a Look-Up Table . 
In practice the size of this look-up table can be reduced 
considerably by the use of difference techniques. 



Note that this pre-computed look-up table can take account 
of the true geometry of the insonified scan, and allow for 
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curvature of the echo wavefront. ie. dynamic focussing can 
be achieved by correctly computing the look-up table. 

Suppose that t k is the stored value of the time delay 
for the wave-front to arrive at the transducer, from a 
pixel point, P. Then this value tk can be used to find the 
nearest sample to this time delay in the sample set, and 
hence the nearest set of local frequency components {aj^}, 
{ b k,n> of that transducer in the Frequency Component Store. 
In general the nearest sample will not have precisely the 
required time delay. 

The residual time difference, e, is corrected by generating 
the time-shifted set of frequency components { a? k n} * 
{ b 'k,n> using equation 5.1, where u n = '27rf n ,e. 

The above procedure gives the interpolated local 
spectral decomposition of each transducer signal for 
precisely the required time delay corresponding to a pixel 
point, P. 

5.3.1.8 Image Intensity Estimation 

The first stage of imaging is to estimate the spectral 
composition of the delay-sum signal. This can be carried out 
in the frequency domain by adding the in-phase and 
quadrature components over the set of transducers: 

A n •= S(a' kfn ) , B n = Z(b' k/n ) (5.2) 
k k 

{A n }, {B n } gives the spectral decomposition of the required 
composite signal. If the outgoing pulse was transmitted by a 
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non-chirp source then the total local signal power due to 
the echo from P is given by: 

W p = S(A 2 + B 2 ) • (5-3) 
n n 

The intensity of the pixel in the image corresponding 
to P is then made suitably dependent on W p (eg. proportional 
to W, sqrt(W) , log(W) etc depending on the requirement) . The 
imaging performance of the equipment , as indicated by the 
point-spread function for each pixel point, can be modified 
in detail by using the more general expressions for the 
composite signal coefficients: 

A n = 2(h k a' k#n ), B n = 3C(h k ,b' kn ) - (5,4) 
k 

where the {h k } are precomputed weights associated with each 
transducer in the receiver array. 

5.3.1.9 Processing Steps 

In order to compute the image intensity for all points 
in a given image, the processing can be subdivided into ( 
stages in many different ways. For example it is possible to 
carry out all processing for each frequency component in 
turn for all image points. 

The contribution, A 2 + B 2 to the power, W, at each 

n n 

image point (Eq. 5.3) is then added into the image register. 
This processing continues until all frequency components 
have been processed. Alternatively the processing can be 
carried out for each pixel in turn for all frequencies. The 
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processing can also be split between different processing 
units operating in parallel* 

5.3.2 Local Spectral Estimation using a Convolution Kernel 
Set 

5.3.2.1 Introduction 

The operation "Estimate local spectral components" in 
the Block Schematic (Fig. 5) covers a range of possible 
operations. Each sampled transducer echo consists of a 
sequence of values, {S n } . The generation of the m'th 
spectral component, c, r , m , centered on a sample, Sr, is 
achieved by means of the convolution: 

j=R 

c r,m = 2(*m, j s r-j> 

The length of the kernel {k m ,j} is 2R+1. Typically the 
entire set of component values for a given transducer can be 
generated by passing the sequence {s n } through a transverse 
filter loaded with the particular kernel values. 

The optimum kernel set to be used depends on many 
parameters: 

Source signature; 

Carrier Frequency (ies) 
Nature of imaging task (eg. survey, isolated target 
identification, statistical classification of 
seafloor) 
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Sampling rate 

Available processing capacity: 
Maximum digitisation rate available - 

Nevertheless a common processing technique can be used 
in which just the convolution kernels are modified. 

In general higher sampling rates will improve image 
quality, and reduce artefacts due to random noise; however 
the processing and digitisation rate increases 
correspondingly. It is one of the aims of the invention to 
allow imaging using sampling rates down to the theoretical 
lower limit of twice the signal component of the echo 
bandwidth (Nyquist) . 

In this section we give some examples of the techniques 
for defining the convolution kernels. 

5.3.2.2 Length of Convolution Kernels 

It is helpful to define the term "local" in "local 
spectral estimation" more carefully. The local echo power 
estimate is normally required averaged over the length on 
the ground corresponding to the pixel separation in the 
range direction. Thus if the image size is 512 x 512 pixels, 
and this image covers a 100 m x 100 m field of view, then 
each pixel is 20 cm long in the range direction. The time 
window in each transducer signal corresponding to the pixel 
spacing in the image is the space distance between pixel 
points divided by the 2-way speed of sound, e.g. 750 m/sec 
in water. In the above example, the time window is 266 
microseconds . 
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The number of samples in the time window depends on the 
sampling rate. Thus if the sampling rate is 2 0 kHz, we have 
13 samples in each time window* These considerations 
determine the length of the kernels in the kernel sets which 
are used for spectral estimation. 

5. 3 . 2 . 3 Types of Signal 

For illustration only, we shall consider four specific 
types of source signature. The echo from the insonified 
scene will have a frequency composition which is related to 
the frequency composition of the source, so that a narrow- 
band source will produce narrow-band echoes, and a wide-band 
source will produce wide-band echoes. The four source 
signatures are: 

(a) minimum (or near-minimum) time-bandwidth modulated 
signals 

(b) band-limited modulated signals 

(c) seismic wavelets 

(d) chirp (swept carrier frequency) sources. 

The first two categories are normally used in sector- 
scan and side-scan sonar. The seismic wavelet would be 
employed for sub-bottom profiling and could be employed for 
swath bathymetry. Chirp (swept frequency) sources may be 
used in each of the above applications. 



5.3.2.4. Minimum Time-Bandwidth Sources 
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A typical source signal has a single carrier frequency 
with an approximately gaussian envelope (Fig 7) . Other pulse 
shapes with well rounded envelopes are also near minimum 
time-bandwidth. We assume that the length of the pulse is 
approximately the same as the pixel spacing in time (which 
is the usual situation). Then the time-bandwidth law asserts 
that the uncertainty in frequency of any spectral estimate 
made during that time window is equal to the bandwidth of 
the signal itself. Hence there is no point in attempting to 
measure more than one frequency component. 

Spectral estimation now reduces to the problem of 
determining the amplitude and phase of the carrier in the 
local echo. The standard solution to this problem is to use 
a quadrature matched filter. A pair of -kernels are created 
whose values are just the sampled source signature, and the 
sampled source signature with carrier phase-shifted by 9 0 
degrees . 

This pair of kernels is now used to generate a single 
pair of Frequency Components in the Frequency Component 
Store. 

5.3.2.5 Band-Limited Sources ( 

The standard technique for local spectral estimation 
used in seismic processing is to carry out a local DFT 
within the time-window. The sampled signal is first padded 
with zeros so that the length is 2**n, e.g 512 or 1024. Then 
the signal is tapered to zero at each end so that it becomes 
approximately periodic, and the standard DFT algorithm is 
applied. The combined operations of taper followed by DFT 
are equivalent to a set of convolution operations. 
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In this instance the signal component of the echo is 
known to consist of a limited range of f requencies . ' Hence 
all frequencies outside this range are ignored. Careful 
choice of sampling frequency avoids aliasing problems. 
Alternatively there are mathematical modifications to the 
Fourier kernels which correct for aliasing to some extent 
(Corrected DFT Technique) . 

An alternative approach is to use a set of quadrature 
bandpass filters to estimate the local spectrum. The number 
of such filters (quadrature-pairs) is equal to the time- 
bandwidth product of the signal to be estimated. This 
approach minimises the number of frequency components which 
are computed. However the DFT solution may have some merit 
if special hardware (DFT chips) can be -employed in the 
computation. 

5.3.2.6 Seismic Wavelets 

A typical wavelet consists of a pair of. sharp positive 
and negative peaks followed by a longer period ripple. The 
spectral composition may have a maximum around 3 kHz, but 
the spectrum will extend from around 1 kHz up to 10 kHz. 
Such a signal can be handled in precisely the same way as 
the band-limited signal discussed earlier, though here the 
minimum sampling frequency given by Nyquist is just twice 
the maximum frequency in the signal, and there is no special 
aliasing problem. 

5.3.2.7 Chirp Sources 4 

For spectral estimation , the chirp source can be 
treated as a band limited source with a rather wide 
bandwidth, and either a DFT kernel set, or the Corrected DFT 



WO 92/00584 



36 



PCT/GB91/01058 



technique of the Quadrature Bandpass Filter technique can be 
used to generate the kernel set. The length of the time- 
window used in the kernel set should be at least the length 
of the chirped pulse, even if the pixel spacing is closer, 
if the pulse compression technique described below is to 
work successfully. 

The final step in image generation (Eg- 5.3 in 5.3.1.8 
above) should be modified to carry out pulse compression of 
the chirped echo. Pulse compression of a chirped echo is 
normally carried out by matched filtering of the echo with ^ 
copy of the chirped source signature. Using digital signal 
processing, both the echo and the source signature are 
sampled. 

Matched filtering in the time-domain is equivalent to 
multiplication of the complex spectrum of the echo by the 
complex spectrum of the chirp source in the frequency 
domain. This is easily achieved with the given processing 
scheme, since the set {A n }, {B n } defined in Sec. 5.3.8 is 
just the complex spectrum of the echo. If the complex 
spectrum of the chirp source, {P n } , {Q n } is precomputed by 
the same technique as that used to estimate the local echo 
spectrum, then: ( 

W P = 2(A n P n - B n Q n ) (5.4) 
n 

Equation 5.4 gives the local power of the pulse compressed 
signal. 

5.3.3 Look-up Tables, Zoom Facility, Display Stabilization 



5.3.3.1 Introduction 
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Much of the power in the holographic system is given by 
the proper design and use of look-up tables . In the basic 
two-dimensional sector scan sonar the correct computation of 
time delays not only provides a dynamic focus facility, but 
also eliminates the stage of polar-to-cartesian grid 
conversion which is required in standard sonar imaging 
systems. For side-scan sonar, the slant-range to true-range 
correction which takes account of the vertical separation of 
the sonar array above the sea-floor can also be built into 
the look-up table values. 

Any change to the image size; for example generating a 
zoomed display of part of the insonified scene, can be done 
be substituting a new look-up table. Similarly image 
stabilization against movement of the sonar platform can be 
done by updating the look-up tables as the platform moves. 

The explicit form of look-up table, in which times to 
each individual transducer from each individual pixel point 
are stored with the necessary precisions, is not convenient 
in a number of respects: 

(a) the table contains a large number of entries, and 
each value must be held with great precision 

(b) the table takes a long time to compute, so is only 
convenient if the image is seldom changed (it can 
then be stored in ROM) 

(c) it is inconvenient for stabilization or zoom. 

As. described in 5. 3. 1.7., the table stores time delays. 
In fact it is more convenient to store values as 
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(delay/sample period) but this is a detail. The following 
sections show how the look-up tables can be structured to 
reduce storage capacity and regeneration time at the expense 
of a slightly greater access time. The method of updating 
the tables to achieve image stabilization is also described. 

Time Delay Look-up Tables for Holographic Imaging 



1- Introduction 

In a basic survey mode of operation, the look-up table ^ 
is fixed for a given location of the imaged scene with 
respect to the transducer array. Hence the Delay Table could 
be precomputed for each standard mode of survey and stored 
in ROM. However, when a 'zoom 1 facility is used, the Delay 
Table for the zoomed window must be generated rapidly if the 
facility is to be of operational value. An even more serious 
problem arises if the imaged scene requires to be stabilized 
against movement of the transducer array, because the look- 
up requires to be refreshed each ping. 

We therefore have an operational requirement to 
regenerate a large accurate look-up table in a fraction of ^ 
second. Clearly a different kind of solution is needed. The 
present invention proposes a solution based on first and 
second order differences from a 'Base Table 1 . 

2 . Outline of Method 



2.1 Basic Tables 
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Figure 8 shows a simple illustration of an insonified 
scene, with a superimposed image grid. The point, s, located 
at the centre of the transducer array is assumed to be the 
source of the transmitted acoustic signal. If it is fixed at 
some other point of the array, minor computational 
differences arise. 

No assumption is made about the grid spacing for the 
array; it may be a suitable grid for surveying the whole 
scene, or a much smaller grid suitable for zoomed, 
stabilised display. In the latter case the basic grid may be 
allowed to cover more of the scene, and hence be bigger than 
the displayed window. 

Given the grid, the (R, 0) coordinates of each grid 
point with respect to S only are computed and stored in a 
pair of basic tables. This R,e table will be referred to as 
the -Polar Base Table'. The R co-ordinates can be stored in 
whatever are most convenient. In this document, distance in 
the water medium and the corresponding time delay at the 
speed of sound are used interchangeably. 

4 

2 - 2 Grid Stabilization against Movement of S 

Suppose that we reguire to stabilize the grid against 
the movement of the array centre from S to S 1 (Fig. 9). 
Movement of an integral number of grid squares presents no 
problem other than relabelling the axes of the existing Base 
Table before access. Consider, therefore, a small vector 
movement of (d,e) within a grid square. To a first order of 
approximation, the new values of R are given by: 

R' = R - d cos (0-9) ^ la y 



WO 92/00584 



40 



PCT/GB91/01058 



8' = e - d sin(<£-8)/R (lb) 

To stabilize the image against array movement through the 
water, it is necessary to generate a modified (R 1 ,©) Table 
from the Polar Base Table each ping using Equation la. The 
change to e from (lb) can almost certainly be ignored. 

2 - 3 Delays for Complete Set of Transducers, Allowing for Yaw 

Figure 10 shows the original image of Figure 8, with 
the array superimposed. At some reference time for image 
stabilization, the array pointed along the Y-axis of the 
grid. Starting from this reference time, it is required to 
stabilize the image against rotation of the array in the 
(X,Y) plane. Suppose the array makes ai] angle, a, with the Y 
axis after several pings in a stabilised mode of operation. 

In this situation, the problem is to use the (R,8) 
Table to compute the table of delays, r j , for the j»th 
individual transducer from the array centre. If there is no 
rotation of the array to consider, we have a special case of 
this problem with a = 0. 

Consider the range, r(l) from some pixel point, P, in { 
the image field to the transducer, located at a distance +1 
from the array centre. From simple trigonometry, r(l) 
satisfies the equation: 

r(l) 2 = R 2 + l 2 + 2R1 cos (7T/2-9-a) , 



i.e. 



r(l) 2 = R 2 + l 2 + 2R1 sin (8 + a) ( 3 ) 
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where R is the range to the array centre, given by the Polar 
Base Table. The solution to this equation is required for 
each value of 1 corresponding to a transducer location on 
the array. If the transducer spacing is a constant equal to 
d 0 , and there are 2m + 1 transducers mounted on the array, 
then 1 takes on the values: 

Lj = jd Q , -m <= j <=m 

Take the derivative of Equation 3, and write G' = e+a, 
to get: 

rdr = [1 + Rsin(e')]dl (4) 

. • j . c ~~ ~ ~ 

Provided d Q « r, the differential equation (4) can be 
replaced with a finite difference equation in which dl 
= d Q . Let the range from P to the j*th transducer be 
r j , and write: 

dr j = r j+1 - r j (5) 
Then substituting in (4), 
rjdrj ■■= [jd Q + Rsin(8 , )]dp 

(6) 

Starting from r Q = R, Equation 6 can be used to 
generate all the rj in the +ve direction. Changing 
the sign of d Q gives the rj in the -ve direction. 

Note that in this difference equation, e' remains fixed 
for all the transducers in the array, and R sin(e f ) is 
also constant. Write 

Hj = [R sin(e f ) + jd 0 ]d 0 
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The difference equations now become 

dHj = d 2 
o 

drj = Hj/rj 

starting from the initial conditions: 
H 0 = d 0 R sin(G') 

r Q =R 

In many situations, it is acceptable to make the 'far- 
field' assumption that the change in r is negligible in 
Equation (7b) . Under these circumstances 

drj = H Q /R = d Q sin (9') .= constant (8a) 

If dynamic focus is required, then the next 
approximation is to form the second difference equation: 

d 2 rj = -Hjdrj/(r 2 ) + dHj /R 

j 



(7a) 



(7b) 



-H 2 /(R 3 ) + d 2 /R 
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= [1 - since 1 ) ]d 2 /R 

o 



= k(R,e'), constant for all transducers (8b) 

Using this approximation, the difference equations 
become: 

Initial conditions : 

d 2 r Q = K(R,6) = constant, 
dr Q = d Q sin(G') , 



r 0 = R 



Increments 



drj = drj-i + K 9 (a) 



= rj + drj 9 (b) 



It depends on the fepeed of division whether Equations 
(9) are much faster to compute than Equation (7). However 
Equations (9) are easier to implement in fixed-point 
arithmetic. 

2 - 4 Creation of Base Table for Zoom Window 
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Here the task is to generate a new Polar Base Table for 
a window centred on an origin with Cartersian coordinates 
x O'Yo- The Polar values r 0 ,e 0 are available for the 
origin, from the existing Polar Base Table. 

Remembering that we are looking for both r and e for 
each grid point in the window, the simplest technique 
seems to be as follows. Let h be the grid spacing in 
both x and y directions. The procedure is to move out 
from the grid square by means of steps in x or y until 
each grid point is computed. One possibility is to mov^ 
first in the +- x directions until the complete x axis 
of the window has been generated; then to move in +- y 
from each x-axis grid point, to cover the whole window. 
The computation required for each step is 

X-Steo 

Let the current point be x n ,y n/ r n ,e n . Then the next 
point is given by: 

x n+l = *n + h 

Yn+1 = Yn # 
r n+l = r n + hcos (9 n ) 
e n+l = arccos (x n+1 /r n+1 ) 

Y-Step 



The next point is given by: 
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x n+l x n 

Yn+1 = Yn + *V 

r n+l - + hsin ( e n) 

e n+l = arcsin (y n +i/r n+1 ) 

2 . 5 Combination of Zoom, Translation, Orientation and Tx 
Displacement 

There is no difficulty in putting the results of 2.2, 
2 . 3 and 2 • 4 together to generate or refresh a complete set 
of stabilized tables. Using the difference equation 
approximations in 2.3, there is no obvious virtue in storing 
values for individual transducer delays, which can be 
generated almost as rapidly as they can be accessed. 

There is an additional virtue in working with 
difference values for the individual transducer arrays. The 
absolute error in the delay values determines the precision 
with which the image is stabilized. The tolerable error is 
some fraction of the acoustic travel time corresponding to 
the image grid spacing, which is usually of the same 
magnitude as the pulse length. Error in computing the delay 
differences between transducers leads to phase errors which 
degrade the imaging process itself . The allowable difference 
error between transducers is therefore some fraction of the 
source signal carrier period. Hence delay differences 
require to be at least one order of magnitude more precise 
than the absolute delay values. The delay differences can be 
converted directly into phase-differences between 
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transducers when the spectral in-phase and quadrature 
components are calculated. 

No attempt is made here to lay out the system 
computation in detail, as this depends on the particular 
modes of operation. It is envisaged that the Polar Base 
Table for the whole scene is precomputed without 
approximation, and perhaps held in ROM. The trig tables sin, 
cos, arcsin, arccos are also precomputed in advance. Working 
tables are then created for a zoomed window, and for display 
stabilization, 

3 . Computation Times 

3 . 1. Stabilization Against Array Movemerit 

Whatever the grid spacing, it is only necessary to 
compute the look-up tables for the pixel array that is 
actually displayed. Assume that this is a 512 x 512 image, 
with 1/4 million pixel points (in practice the image size 
may be somewhat smaller) . Equation (la) requires 2 add 
operations, 1 multiply, and a cosine table look-up for each 
pixel point. Assuming 50 nanoseconds per operation, the 
slowest execution time which can offer any kind of real-time^ 
capability, the computation time to stabilize for array 
translation is 50 ms . 

3 . 2 Individual Transducer Delays 

The next task is to generate the differential delays 
for each of the transducers in the array. Computation of 
initial conditions for the difference equations, (8) or (9) 
above, will also take 50-100 ms, assuming the necessary 
trigonometric function tables are available. Computation of 
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delay difference costs one or two additions per transducer 
per pixel point (test ahd branch instruction may be avoided 
using in-line code) . The total time for 256 x 256 pixel 
points and 40 transducers is around 1 sec. This time is not 
likely to dominate the holographic computation. 

3.3 Zoom Window 

The computing cost is 2 additions, one division 
operation and 2 table look-ups per move. Assuming 50 ns per 
operation, the cost is 250 ns per grid point, and 62.5 ms 
for a 512 x 512 window. If the division operation is too 
expensive, the time can be reduced using a similar 
approximation to the one used to find the individual 
transducer delays, but It is probably not worth the trouble, 
particularly as zoom windows are likely to be smaller than 
512 x 512. 

4 . Conclusion 

Simple computational techniques have been demonstrated 
for generating the delay look-up tables required for 
holographic imaging. Most algorithms start from a derivative 
of the triangle relationship: 

a 2 = b 2 + c 2 - 2cosA 



The approximation is then made of replacing 
infinitesimals with finite differences. 

5*3.4 Application to Swath Bathymetry 
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A particular application of the above general imaging 
scheme is swath bathmetry. The required sonar array 
configuration is similar to sector-scan, except that the 
array points vertically downwards, with the projected fan- 
shaped beam normal to the direction of motion of the sonar 
platform. As the platform moves, a section of images are 
obtained of the sea floor along a line below the array, 
approximately at right angles to the ships track. The array 
itself may be a conventional linear array, or bent in an arc 
around the hull of the ship or towed fish. As no penetration 
is required , high frequencies can be employed as for shorty 
range sedtor-scan sonar. 

The imaging procedure is essentially the same as 
described above, except that the ima^ge is only required in 
the neighbourhood of the expected location of the sea-floor, 
hence the following procedure is adopted. After each ping, 
the image is reconstructed, and a suitable image processing 
algorithm is used to locate the sea-bottom horizon in the 
image. This horizon should be corrected to true depth and 
horizontal offset allowing for the attitude of the sonar 
(yaw, pitch and roll) . 

The imaging area for the next ping is controlled by the 
horizon found in the previous ping or pings, using any 
prediction techniques which may be appropriate. The aim is 
to reduce the number of pixels which are imaged, in order to 
speed up image reconstruction time, and hence increase the 
possible speed of the survey vehicle. 

The embodiments of the invention described herein 
relate generally to systems having linear transducer arrays, 
from which images of two-dimensional sections of the target 
area can be generated, however the invention is equally and 
directly applicable to planar (n x m element) arrays, T- 



WO 92/00584 



PGT/GB91/01058 



49 



shaped arrays and the like which may be used to produce 
three-dimensional images. 
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Claims 

' 1. An acoustic imaging method for marine survey and other 

purposes wherein a target area is insonified by periodic 
acoustic pulses, reflections of said pulses are detected 
by an array of at least two transducers which generate 
output signals in response thereto, and said output 
signals are processed so as to produce an image of all or 
part of the insonified target area, said image comprising 
an array of pixels each corresponding to a point in the 
insonified area and the intensity of each pixel 
representing the strength of the pulse reflected from said 
corresponding point, comprising the steps of: 

(a) sampling the output signals from each of said transducers 
at a predetermined rate during the period between said 
transmitted pulses; 

(b) digitizing and storing said samples; ' 

(c) for each pixel of the image, 

(i) selecting a corresponding set of digitized samples 
from each transducer, the selection of the sample 

set being determined by the time of flight of a 
transmitted pulse to the point in the insonified 
area corresponding to the pixel and back to the 
particular transducer in the array; 

(ii) correcting each selected sample set by 
interpolation so that it is precisely 

aligned with the required time of flight by: 

estimating the in-phase and quadrature coefficients 
for one or more frequency components present in each 
sample set by convolution of the sample set with one 
or more pairs of sets of predetermined coefficients; 
and computing the frequency coefficients for the 
required time-shifted sample set by phase-shifting 
the pairs estimated pairs of coefficients for each 
frequency component; 

(iii) combining the phase-shifted coefficients for each 
frequency component from all transducers to generate 
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the corresponding coefficients for a composite 
signal; 

(iv) deriving the strength of the reflected pulse and 
hence intensity of the pixel from the frequency 
coefficients of the composite signal - 

2. The method of claim 1 / wherein said in-phase and 
quadrature coefficients for said one or more frequency 
components are estimated using quadrature matched filtering. 

3. The method of claim 1, wherein said in-phase and 
quadrature coefficients for said one or more frequency 
components are estimated using Discrete Fourier Transform 
computation . 

4. The method of any of claims 1, 2 or 3 , wherein step (iv) 
of claim 1 includes adding the cross-products of the in-phase 
and quadrature frequency components of the composite signal 
with the corresponding predetermined frequency component of 
the transmitted pulse so as to effect pulse-compression of 
frequency modulated transmitted pulses. 

5. The method of any preceding claim, wherein the times of 
flight of a transmitted pulse to each point in the insonified 
area corresponding to each pixel are obtained from values 
stored in a look-up table. 

6. The method of claim 5, wherein said stored values are 
wholly predetermined. 

7. The method of claim 6, wherein said stored values are 
partly predetermined. 

8. The method of claim 5, claim 6, or claim 7, wherein said 
stored values are computed to provide geometric correction of 
the time of flight for pixels corresponding to points in the 
near field of the insonified area. 

9. The method of any of claims 5 to 8, wherein said stored 
values are computed to provide geometric correction of slant- 
range to true-range for side-scan sonar applications. 

10. The method of any of claims 5 to 9 f wherein said stored 
values are computed to provide imaging in a selected frame of 
reference. 
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11. The method of any of claims 5 to 10, wherein said stored 
values are recomputed to provide an enlarged display of a 
selected part of a previously generated display. 

12. The method of any of claims 5 to 11, wherein said look-up 
tables are generated or updated on the basis of the time delay 
from a given pixel point to a selected reference element on 
the array plus the differential delays to each other 
transducer of the array. 

13. The method of claim 12, wherein the generation and 
updating of said tables is effected, by the use of finite 
difference equations allowing appropriate angular 
relationships in the insonified area to be imaged. 

14. The method of any preceeding claim, adapted for swath 
bathymetry applications wherein said transducer array includes 
an acoustic transmitter array and an acoustic receiver array 
mounted on a vessel or other survey vehicle, further 
comprising the steps of: 

(a) orienting the transmitter array in such a manner that a 

narrow strip of the sea-floor is insonified at right 
angles to the direction of motion of the vessel or other 
vehicle; 

(b) orienting the receiver array in such a manner as to image 

tne sector below the array including the insonified sea- 
floor intercept ; 

(c) after each pulse transmission, imaging a selected area 

of the scene which includes the sea-floor intercept 
using the method of any preceeding claim; 

(d) locating the pixels in the image corresponding to the sea- 

floor intercept by means of standard signal or image 
processing techniques; and 

(e) using an horizon intercept determined from one or more 

previous insonificat ions to select the area for which the 
image needs to be computed after the next insonif ication. 
15. An acoustic imaging apparatus for marine survey and other 
purposes comprising transmitter means for transmitting 
periodic acoustic pulses, an array of at least two transducers 
for detecting reflections of said pulses from a target area 
and for generating output signals in response thereto, and 
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means for processing said output signals so as to produce an 
image of at least a part of said target area, said image 
comprising an array of pixels each corresponding to a point in 
said target area and the intensity of each pixel representing 
the strength of the reflected pulse from said corresponding 
points , and further comprising: 

data acquisition and storage means for sampling the output 
signals from each of said transducers at a predetermined rate 
during the period between successive transmitted pulses and 
for digitising and storing said samples; and wherein 

said data processing and image generation means is adapted 
to select a set of digitised samples from each transducer for 
each pixel of the image, said selection being determined by 
the time of flight of pulse from the transmitter means to the 
corresponding point in the target area and back to the array, 
to correct each selected sample set by interpolation so that 
it is precisely aligned with the required, time of *f light by, 
estimating the in-phase and quadrature coeff ieients for one or 
more frequency components present in each sample set by 
convolution of the sample set with one or more pairs of sets 
of predetermined coefficients, and computing the frequency 
coefficients for the required time shifted sample set by 
phase-shifting the estimated pairs of coefficients for each 
frequency component, and combining the phase-shifted 
coefficients for each frequency component from all transducers 
to generate corresponding coefficients for a composite signal^^ 
in order to derive the strength of the reflected pulse and 
hence intensity of the pixel from the frequency coefficients 
of the composite signal, 

16. An acoustic imaging apparatus as claimed in claim 15, 
wherein the data acquisition and storage means includes means 
for amplifying the analogue signals received from the 
transducers of the array, analogue to digital conversion means 
for sampling the analogue signals, and means for multiplexing 
the signals from each transducer channel. 

17. An acoustic imaging apparatus as claimed in claim 16, 
wherein the analogue output signals from each transducer 
channel are amplified and digitised in parallel, and the 
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parallel, digital signals are digitally multiplexed prior to 
storage, 

18. An acoustic imaging apparatus as claimed in claim 16/ 
wherein the analogue output signals from the transducers are 
amplified separately in a first amplification stage, the 
parallel, amplified analogue signals are analogue multiplexed, 
and the multiplexed, analogue signal is further amplified 
prior to digitisation and storage. 

19. An acoustic imaging apparatus as claimed in 

claim 18, wherein the further amplification stage is a digital 
switched gain stage wherein the gain is adjusted to compensate 
for attenuation of the reflected signals. 

20. An acoustic imaging apparatus as claimed in claim 19, 
wherein the pre-amplif ication and digital switched gain stages 
of each channel prior to digitisation are similar to one 
another, 

21. An acoustic imaging apparatus as claimed in any of claims 
15 to 20, wherein said data acquisition and storage means 
includes timing and control means to control the multiplexing 
and digitising means. 

22. An acoustic imaging apparatus as claimed in claim 21 
when dependent upoi^ claim 19 or 20, wherein said timing and 
control means further controls said digital switched gain 
stages • 
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Fig. 1 
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Fig 2(a) 




Serial Implementation 



Fig. 2(b) 
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